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(54) COMMUNICATION APPARATUS AND COMMUNICATION METHOD 

to end the separation of the caption. 
Fig. 1 



(57) A hybrid terminal of a mobile phone and a digital 
broadcast receiver allows calling on the mobile phone 
while at the same time receiving a digital broadcast itself 
even in the event of receiving a call while at the same 
time receiving the digital broadcast. Upon receiving a 
call while at the same time receiving a digital broadcast, 
a telephone RF unit 113 sends a receive invent to an 
event analysis processing unit 112. The event analysis 
processing unit 112 makes a request to a program in- 
formation processing unit 1 04 for displaying the caption, 
and at the same time makes a request to an audio path 
switching control unit 109 for switching the audio path 
to the output side of a telephone audio processing unit 
114. The program information processing unit 104 
makes a multiplexed transmission separating unit 103 
separate the caption and a caption/data broadcast 
processing unit 1 05 decodes separated caption data. A 
display superimposing unit 1 08 superimposes a decod- 
ed caption output onto a decoded video output, and a 
display output unit 1 1 0 displays it. When the user press- 
es a call start/end button 116, a call start event is sent 
to the event analysis processing unit 112, and the event 
analysis processing unit 112 makes a call request to a 
telephone RF unit so as to start a call. When the user 
presses the call start/end button 1 1 6 to end the call, the 
event analysis processing unit 112 makes a call end re- 
quest to the telephone RF unit 1 1 3 so as to end the call. 
The event analysis processing unit 1 1 2 at the same time 
makes a request to the audio path switching control unit 
109 for switching the audio path to the side of a digital 
broadcast audio processing 1 07 so as to switch the au- 
dio path. The event analysis processing unit 112 also 
makes a request to the program information processing 
unit 104 for ending the separation of the caption so as 
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Description 

Technical Field 

[0001] The present invention relates to a communica- 
tion apparatus incorporating a telephone function and a 
digital broadcast receiving function, and a communica- 
tion method of transmitting/receiving telephone audio 
data and receiving a digital broadcast. 

Background Art 

[0002] Rapid growth of mobile phones results greatly 
from the fact that they are equipped not only with the 
original telephone function but also with other functions 
such as the WEB browser function and the email func- 
tion. Mobile phones are still now evolving with additional 
functions such as the Java application function and the 
video phone function. 

[0003] Japan has already launched Digital Satellite 
Broadcasting services such as CS (Communication 
Satellite) and BS (Broadcasting Satellite), and sched- 
uled to launch digitalized broadcasting services also for 
ground-based broadcasting in 2003. Terminals for re- 
ceiving ground-based digitalized broadcasting have 
been developed to include even a mobile terminal for 
local reception, and thus preparations have been car- 
ried out for the start of the services. 
[0004] Future mobile phones are projected to include 
functions for receiving digitalized broadcasts as well as 
the WEB browser function and the email function. At 
present, however, there seems to exist no prior art in the 
field of problems that the present invention is directed 
to solving. 

[0005] Now, Japanese Unexamined Patent Publica- 
tion No. Hei 6-1 65 073 will now be cited as a related art 
reference. 

[0006] Fig. 8 shows the block diagram of the refer- 
ence. According to this invention, when a mute button 
is pressed by a remote control transmitter 9 or a key- 
board 8 attached to the body, muting is activated, and 
at the same time a caption decoder ON/OFF control unit 
10 turns on a caption decoder 3 to display multiplexed 
caption data via a display processing unit 5. 
[0007] While muted and the caption decoder is on, on 
the other hand, when a demute button is pressed by the 
remote control transmitter 9 or the keyboard 8 attached 
to the body, demuting is activated and at the same time 
the caption decoder ON/OFF control unit 1 0 turns off the 
caption decoder 3 so that video is displayed alone via 
the display processing unit 5. 

[0008] Japanese Unexamined Patent Publication No. 
Hei 6-165073 is directed to muting and displaying cap- 
tion data, but not to implementing other functions. 
[0009] With a projected future integration of a mobile 
phone and a digital broadcasting receiver, it may be as- 
sumed that a call is received or otherwise requested 
while a digital broadcast program is received. 



[0010] Furthermore, the display of a future hybrid ter- 
minal of a mobile phone and a digital broadcast receiver 
can be anticipated small in size. This may pose a prob- 
lem of conspicuousness with a constant caption display. 
5 [0011] The present invention is directed to allowing 
calling on the phone "while" receiving a digital broad- 
cast, and minimizing the period of caption display of a 
digital broadcast. 

10 Disclosure of the Invention 

[0012] A communication apparatus according to the 
present invention is characterized by including: 

15 a multiplexed data receiving unit for receiving mul- 
tiplexed data at least including audio data; 
an extracting unit for extracting the audio data from 
the multiplexed data; 

a telephone unit for transmitting/receiving tele- 

20 phone audio data; 

an audio output unit for inputting one of extracted 
audio data that was extracted by the extracting unit 
and received telephone audio data that was re- 
ceived by the telephone unit, and outputting one of 

25 the extracted audio data inputted and the received 
telephone audio data inputted; 
a switching control unit for switching an input to the 
audio output unit between the extracted audio data 
and the received telephone audio data; and 

30 an instructing unit for detecting a receive event gen- 
eration, a send event generation, and an end event 
generation, and giving a prescribed instruction to 
the telephone unit, the extracting unit, and the 
switching control unit. 

35 

[0013] Then, the instructing unit, in the case of detect- 
ing one of the receive event generation and the send 
event generation while the multiplexed data is received 
by the multiplexed data receiving unit, transmits a tele- 

40 phone audio data transmission/reception start instruc- 
tion to the telephone unit to start transmitting/receiving 
the telephone audio data, transmits an audio data ex- 
traction stop instruction to the extracting unit to stop ex- 
tracting the audio data, and transmits a received tele- 

45 phone audio data switch instruction to the switching con- 
trol unit to switch to the received telephone audio data, 
and in the case of detecting the end event generation 
while the multiplexed data is received by the multiplexed 
data receiving unit, transmits a telephone audio data 

50 transmission/reception stop instruction to the telephone 
unit to stop transmitting/receiving the telephone audio 
data, transmits an audio data extraction start instruction 
to the extracting unit to start extracting the audio data, 
and transmits an extracted audio data switch instruction 

55 to the switching control unit to switch to the extracted 
audio data. 

[0014] Then, the telephone unit, in the case of receiv- 
ing the telephone audio data transmission/reception 
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start instruction from the instructing unit, starts transmit- 
ting/receiving the telephone audio data, and in the case 
of receiving the telephone audio data transmission/re- 
ception stop instruction from the instructing unit, stops 
transmitting/receiving the telephone audio data. 
[0015] Then, the extracting unit, in the case of receiv- 
ing the audio data extraction stop instruction from the 
instructing unit, stops extracting the audio data, and in 
the case of receiving the audio data extraction start in- 
struction, starts extracting the audio data. 
[0016] Then, the switching control unit, in the case of 
receiving the received telephone audio data switch in- 
struction from the instructing unit, switches the input to 
the audio output unit to the received telephone audio 
data, and in the case of receiving the extracted audio 
data switch instruction from the instructing unit, switches 
the input to the audio output unit to the extracted audio 
data. 

[0017] The multiplexed data receiving unit is charac- 
terized by receiving multiplexed data including video da- 
ta and text data. 

[0018] Then, the extracting unit is characterized by 
extracting the video data from the multiplexed data, and 
also extracts the text data in a prescribed case. 
[0019] Then, the communication apparatus is charac- 
terized by further including a display output unit for out- 
putting extracted video data that was extracted by the 
extracting unit, and for outputting extracted text data in 
the case where the text data was extracted by the ex- 
tracting unit. 

[0020] Then, the instructing unit is characterized by 
transmitting a text data extraction start instruction to the 
extracting unit to start extracting the text data in the case 
of detecting one of the receive event generation and the 
send event generation while the multiplexed data is re- 
ceived by the multiplexed data receiving unit, and trans- 
mitting a text data extraction stop instruction to the ex- 
tracting unit to stop extracting the text data in the case 
of detecting the end event generation while the multi- 
plexed data is received by the multiplexed data receiv- 
ing unit. 

[0021] Then, the extracting unit is characterized by 
starting extracting the text data in the case of receiving 
the text data extraction start instruction from the instruct- 
ing unit, and stopping extracting the text data in the case 
of receiving the text data extraction stop instruction from 
the instructing unit. 

[0022] The audio output unit is characterized by being 
an amplified audio output unit for amplifying volume of 
and then outputting one of the extracted audio data in- 
putted and the received telephone audio data inputted 
and outputting. 

[0023] Then, the communication apparatus is charac- 
terized by further including: 



lecting one of the amplified audio output unit and 
the ear audio output unit, and making the one of the 
amplified audio output unit and the ear audio output 
unit output the received telephone audio data based 
5 on a selected result. 

[0024] Then, the instructing unit is characterized by 
transmitting an amplified audio select instruction to the 
amplified audio ear audio selecting unitto select the am- 
10 plified audio output unit in the case of detecting one of 
the receive event generation and the send event gener- 
ation while the multiplexed data is received by the mul- 
tiplexed data receiving unit. 

[0025] Then, the amplified audio ear audio selecting 
15 unit is characterized by selecting the amplified audio 
output unit in the case of receiving the amplified audio 
select instruction from the instructing unit, and making 
the amplified audio output unit output the received tele- 
phone audio data. 
20 [0026] The communication apparatus is character- 
ized by further including: 

a multiplexed data reception start time managing 
unit, for managing time for the multiplexed data re- 
25 ceiving unit to start receiving the multiplexed data 
as multiplexed data reception start time, transmit- 
ting with an arrival of the multiplexed data reception 
start time a multiplexed data reception start instruc- 
tion to the multiplexed data receiving unit to start 
30 receiving the multiplexed data, and transmitting a 
multiplexed data reception start notification to the 
instructing unit of a start of receiving the multiplexed 
data by the multiplexed data receiving unit. 

35 [0027] Then, the multiplexed data receiving unit is 
characterized by starting receiving the multiplexed data 
in the case of receiving the multiplexed data reception 
start instruction from the multiplexed data reception start 
time managing unit. 

40 [0028] Then, the instructing unit is characterized by 
judging whether the telephone audio data is being trans- 
mitted/received by the telephone unit upon receiving the 
multiplexed data reception start notification from the 
multiplexed data reception starttime managing unit, and 

45 transmitting the audio data extraction stop instruction to 
the extracting unit in the case where the telephone audio 
data is being transmitted/received by the telephone unit, 
so that the instructing unit does not transmits the ex- 
tracted audio data switch instruction to the switching 

50 control unit. 

[0029] The communication apparatus is character- 
ized by further including: 

a multiplexed data reception start time managing 
unit, for managing time for the multiplexed data re- 
ceiving unit to start receiving the multiplexed data 
as multiplexed data reception start time, transmit- 
ting with an arrival of the multiplexed data reception 



55 

a ear audio output unit for outputting the received 
telephone audio data in a prescribed case; and 
an amplified audio ear audio selecting unit for se- 
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start time a multiplexed data reception start instruc- 
tion to the multiplexed data receiving unit to start 
receiving the multiplexed data, and transmitting a 
multiplexed data reception start notification to the 
instructing unit of a start of receiving the multiplexed 
data by the multiplexed data receiving unit. 

[0030] Then, the multiplexed data receiving unit is 
characterized by starting receiving the multiplexed data 
in the case of receiving the multiplexed data reception 
start instruction from the multiplexed data reception start 
time managing unit. 

[0031] Then, the instructing unit is characterized by 
judging whetherthetelephone audio data is being trans- 
mitted/received by the telephone unit upon receiving the 
multiplexed data reception start notification from the 
multiplexed data reception start time managing unit, and 
transmitting the text data extraction start instruction to 
the extracting unit in the case where the telephone audio 
data is being transmitted/received by the telephone unit. 
[0032] The communication apparatus is character- 
ized by further including: 

a vibrator; and 

a vibrator control unit for controlling the vibrator. 

[0033] Then, the instructing unit is characterized by 
judging whetherthetelephone audio data is being trans- 
mitted/received by the telephone unit in the case of re- 
ceiving the multiplexed data reception start notification 
from the multiplexed data reception start time managing 
unit, and transmitting a vibrator start instruction to the 
vibrator control un it to start the vibrator in the case where 
the telephone audio data is being transmitted/received 
by the telephone unit. 

[0034] Then, the vibrator control unit is characterized 
by starting the vibrator in the case of receiving the vi- 
brator start instruction from the instructing unit. 
[0035] The communication apparatus is character- 
ized by being a mobile type communication apparatus. 
[0036] A communication method according to the 
present invention is characterized by including: 

a multiplexed data receiving step for receiving mul- 
tiplexed data at least including audio data; 
an extracting step for extracting the audio data from 
the multiplexed data; 

a telephone audio data transmitting/receiving step 
for transmitting/receiving telephone audio data; 
an audio output step for inputting one of extracted 
audio data that was extracted by the extracting step 
and received telephone audio data that was re- 
ceived by the telephone audio data transmitting/re- 
ceiving step, and outputting one of the extracted au- 
dio data inputted and the received telephone audio 
data inputted; 

a switching control step for switching an input to the 
audio output step between the extracted audio data 



and the received telephone audio data; and 
an instructing step for detecting a receive event 
generation, a send event generation, and an end 
event generation, and giving a prescribed instruc- 
5 tion to the telephone audio data transmitting/receiv- 

ing step, the extracting step, and the switching con- 
trol step. 

[0037] Then, the instructing step, in the case of de- 

10 tecting one of the receive event generation and the send 
event generation while the multiplexed data is received 
by the multiplexed data receiving step, gives a tele- 
phone audio data transmission/reception start instruc- 
tion to the telephone audio transmitting/receiving step 

15 to start transmitting/receiving the telephone audio data, 
gives an audio data extraction stop instruction to the ex- 
tracting step to stop extracting the audio data, and gives 
a received telephone audio data switch instruction to the 
switching control step to switch to the received tele- 

20 phone audio data, and in the case of detecting the end 
event generation while the multiplexed data is received 
by the multiplexed data receiving step, gives a tele- 
phone audio data transmission/reception stop instruc- 
tion to the telephone audio transmitting/receiving step 

25 to stop transmitting/receiving the telephone audio data, 
gives an audio data extraction start instruction to the ex- 
tracting step to start extracting the audio data, and gives 
an extracted audio data switch instruction to the switch- 
ing control step to switch to the extracted audio data. 

30 [0038] Then, the telephone audio transmitting/receiv- 
ing step, in the case of receiving the telephone audio 
data transmission/reception start instruction from the in- 
structing step, starts transmitting/receiving the tele- 
phone audio data, and in the case of receiving the tele- 

35 phone audio data transmission/reception stop instruc- 
tion from the instructing step, stops transmitting/receiv- 
ing the telephone audio data. 

[0039] Then, the extracting step, in the case of receiv- 
ing the audio data extraction stop instruction from the 

40 instructing step, stops extracting the audio data, and in 
the case of receiving the audio data extraction start in- 
struction, starts extracting the audio data. 
[0040] Then, the switching control step, in the case of 
receiving the received telephone audio data switch in- 

45 struction from the instructing step, switches the input to 
the audio output step to the received telephone audio 
data, and in the case of receiving the extracted audio 
data switch instruction from the instructing step, switch- 
es the input to the audio output step to the extracted 

50 audio data. 

[0041 ] The multiplexed data receiving step is charac- 
terized by receiving multiplexed data including video da- 
ta and text data. 

[0042] Then, the extracting step is characterized by 
55 extracting the video data from the multiplexed data, and 
also extracting the text data in a prescribed case. 
[0043] Then, the communication method is character- 
ized by further including: 
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a display output step for outputting extracted video 
data that was extracted by the extracting step, and 
in the case where the text data was extracted by the 
extracting step, outputting extracted text data that 
was extracted. 

[0044] Then, the instructing step is characterized by 
giving a text data extraction start instruction to the ex- 
tracting step to start extracting the text data in the case 
of detecting one of the receive event generation and the 
send event generation while the multiplexed data is re- 
ceived by the multiplexed data receiving step, and giving 
a text data extraction stop instruction to the extracting 
step to stop extracting the text data in the case of de- 
tecting the end event generation while the multiplexed 
data is received by the multiplexed data receiving step. 
[0045] Then, the extracting step is characterized by 
starting extracting the text data in the case of receiving 
the text data extraction start instruction from the instruct- 
ing step, and stopping extracting the text data in the 
case of receiving the text data extraction stop instruction 
from the instructing step. 

Brief Description of the Drawings 

[0046] Fig. 1 is a block diagram of a hybrid terminal 
of a mobile phone and a digital broadcast receiver ac- 
cording to a first embodiment. 

[0047] Fig. 2 is a flowchart illustrating a control flow 
for receiving a phone call. 

[0048] Fig. 3 is a diagram illustrating events and 
states that are managed by an event analysis process- 
ing unit. 

[0049] Fig. 4 is a block diagram of a hybrid terminal 
of a mobile phone and a digital broadcast receiver ac- 
cording to a second embodiment. 
[0050] Fig. 5 is a block diagram of a hybrid terminal 
of a mobile phone and a digital broadcast receiver ac- 
cording to a third embodiment. 

[0051] Fig. 6 is a flowchart illustrating a control flow 
for starting the reception of a digital broadcast. 
[0052] Fig. 7 is a block diagram of a hybrid terminal 
of a mobile phone and a digital broadcast receiver ac- 
cording to a fourth embodiment. 
[0053] Fig. 8 shows conventional art. 

Best Mode for Carrying out the Invention 

Embodiment 1 . 

[0054] Fig. 1 shows a hybrid terminal for mobile phone 
and digital broadcast reception according to a first em- 
bodiment of the present invention. With referring to the 
figure, a reference numeral 1 01 denotes a digital broad- 
cast tuner unit, a reference numeral 1 02 denotes a dig- 
ital broadcast demodulating unit, a reference numeral 
1 03 denotes a multiplexed transmission separating unit, 
a reference numeral 1 04 denotes a program information 



processing unit, a reference numeral 105 denotes a 
caption/data broadcast processing unit, a reference nu- 
meral 106 denotes a digital broadcast video processing 
unit, a reference numeral 107 denotes a digital broad- 

5 cast audio processing unit, a reference numeral 1 08 de- 
notes a display superimposing unit, a reference numeral 
109 denotes an audio path switching control unit, a ref- 
erence numeral 1 1 0 denotes a display output unit, a ref- 
erence numeral 1 1 1 denotes an audio output unit, a ref- 

10 erence numeral 1 1 2 denotes an event analysis process- 
ing unit, a reference numeral 113 denotes a telephone 
RF unit, a reference numeral 114 denotes a telephone 
audio processing unit, a reference numeral 1 1 5 denotes 
an audio input unit, a reference numeral 116 denotes a 

15 call start/end button, a reference numeral 117 denotes 
a CPU, and a reference numeral 1 1 8 denotes a memory. 
[0055] The digital broadcast tuner unit 1 01 receives a 
digital broadcast wave including video data, audio data, 
and caption data (text data) multiplexed. The digital 

20 broadcast tuner unit 1 01 is an example of a multiplexed 
data receiving unit, and the digital broadcast wave that 
the digital broadcast tuner unit 1 01 receives is an exam- 
ple of multiplexed data. 

[0056] The digital broadcast demodulating unit 102 
25 demodulates the digital broadcast wave received at the 
digital broadcast tuner unit 1 01 . 

[0057] The multiplexed transmission separating unit 

103 separates a relevant stream or section data from 
the multiplexed data (extracting video data, audio data, 

30 etc.). This is well known art in digital broadcast process- 
ing, and therefore will not be elaborated here. The mul- 
tiplexed transmission separating unit 103 stops sepa- 
rating digital broadcast audio data and starts separating 
caption data in a prescribed case. It is to be noted that 

35 the multiplexed transmission separating unit 103 is an 
example of an extracting unit. Also, video data separat- 
ed by the multiplexed transmission separating unit 1 03 
corresponds to extracted video data, audio data sepa- 
rated by the multiplexed transmission separating unit 

40 103 corresponds to extracted audio data, and caption 
data separated by the multiplexed transmission sepa- 
rating unit 103 corresponds to extracted text data. 
[0058] The program information processing unit 104 
can judge the presence or absence of monomedia, such 

45 as video data, audio data, and caption data (text data) 
that are multiplexed in a broadcast program, and a data 
broadcast, and know the separation information thereof 
based on incoming program information carried by the 
digital broadcast wave. This is well known art in digital 

50 broadcast processing, and therefore will not be elabo- 
rated here. Also, the program information processing 
unit 1 04 gives instructions with reference to program in- 
formation to the multiplexed transmission separating 
unit 103 to stop separating the audio data of a digital 

55 broadcast, and to start separating caption data if the dig- 
ital broadcast includes the caption data. In the absence 
of caption data, the program information processing unit 

1 04 gives instructions only to stop separating the audio 
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data of a digital broadcast and perform muting. 
[0059] It is to be noted that the program information 
processing unit 104, as well as the event analysis 
processing unit 112 which is described later, corre- 
sponds to an example of an instructing unit. 
[0060] The caption/data broadcast processing unit 

105 performs data processing required for displaying 
caption data and various types of other data (such as 
decoding caption data). 

[0061] The digital broadcast video processing unit 

106 performs data processing required for displaying 
video data (such as decoding video data). 

[0062] The digital broadcast audio processing unit 

107 performs data processing required for outputting 
audio data (such as decoding audio data). Also, it mutes 
audio data in a prescribed case. 

[0063] The display superimposing unit 108 has the 
function of superimposing video data onto different vid- 
eo data, or superimposing caption data onto video data. 
Also, it displays superimposed video data or caption da- 
ta on the display output unit 110. This is well known art 
in digital broadcast processing, and therefore will not be 
elaborated here. 

[0064] The display output unit 110 displays data su- 
perimposed by the display superimposing unit 108. 
[0065] The audio path switching control unit 109 
switches the audio path (input to the audio output unit 
1 1 1 ) to the telephone side or the digital broadcast audio 
side, and makes audio output through the audio output 
unit 111 . It is to be noted that the audio path switching 
control unit 1 09 is an example of a switching control unit. 
[0066] The audio output unit 111 outputs telephone 
audio data from the telephone audio processing unit 1 1 4 
when the audio path is on the telephone side, and out- 
puts audio data from the digital broadcast audio 
processing unit 1 07 when the audio path is on the digital 
broadcast audio side. 

[0067] The event analysis processing unit 112 gives 
instructions to the program information processing unit 
1 04 to mute a digital broadcast and display caption data, 
upon receiving or transmitting a call while the user is 
watching and listening to the digital broadcast. Also, the 
event analysis processing unit 112 at the same time 
gives instructions to the audio path switching control unit 
109 to switch the audio path to the output side of the 
telephone audio processing unit. Also, when the user 
ends a call while at the same time receiving a digital 
broadcast, the event analysis processing unit 112 gives 
instructions to the program information processing unit 
1 04 to restore the audio data of the digital broadcast and 
delete the caption data. Still also, the event analysis 
processing unit 112 gives instructions to the audio path 
switching control unit 1 09 to switch the audio path to the 
outputside of the digital broadcast audio processing unit 
107. 

[0068] It is to be noted that a combination of the event 
analysis processing unit 112 and the program informa- 
tion processing unit 104 corresponds to an instructing 



unit. 

[0069] The telephone RF unit 1 1 3, the telephone au- 
dio processing unit 114, the audio input unit 115 and the 
call start/end button 1 1 6 are components for implement- 
5 ing the telephone function and correspond to a tele- 
phone unit if combined. 

[0070] Also, the hybrid terminal according to this em- 
bodiment is an example of a communication apparatus. 
[0071] An operation will now be discussed. 
10 [0072] Firstly, a description will be given of the case 
of receiving a call while the user is watching and listen- 
ing to a digital broadcast program. 
[0073] This case includes the situation that a digital 
broadcast wave is being received by the digital broad- 
's cast tuner unit 101 , the separation processing of video 
data and audio data is being performed in the multi- 
plexed transmission separating unit 103, video data is 
being outputted from the display output unit 110, and 
audio data is being outputted from the audio output unit 
20 111. Meanwhile, the audio path is set on the side of the 
digital broadcast audio by the audio path switching con- 
trol unit 109. 

[0074] Upon receiving a call while the user is watching 
and listening to a digital broadcast program, the tele- 
25 phone RF unit 113 sends a receive event to the event 
analysis processing unit 112. 

[0075] The event analysis processing unit 112 detects 
the receive event and gives instructions to the program 
information processing unit 104 to mute the digital 

30 broadcast audio and display the caption data. At the 
same time, the event analysis processing unit 1 1 2 trans- 
mits an instruction message (received telephone audio 
data switch instruction) to the audio path switching con- 
trol unit 109, instructing to switch the audio path to the 

35 output side of the telephone audio processing unit 114. 
[0076] The program information processing unit 104 
transmits an instruction message to the multiplexed 
transmission separating unit 103 with reference to the 
program information. More specifically, the program in- 

40 formation processing unit 104 transmits an instruction 
message to stop separating the audio data of the digital 
broadcast (audio data extraction stop instruction). In the 
case of having caption data, the program information 
processing unit 1 04 transmits an instruction message to 

45 start separating the caption data (text data extraction 
start instruction). Without having caption data, it in- 
structs to stop separating the audio data of the digital 
broadcast only. 

[0077] The multiplexed transmission separating unit 
50 1 03 stops separating the audio data of the digital broad- 
cast and starts separating the caption data. The digital 
broadcast audio processing unit 107 performs muting 
and the caption/data broadcast processing unit 1 05 de- 
codes the caption data. 
55 [0078] The display superimposing unit 108 superim- 
poses the caption data onto the video data and displays 
it on the display output unit 110. 
[0079] In the meantime, the audio path switching con- 
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trol unit 109 switches the audio path to the telephone 
side. 

[0080] When the user presses the call start/end but- 
ton 1 1 6, the event analysis processing unit 1 1 2 receives 
a call start event and transmits an instruction message 
(telephone audio data transmission/reception start in- 
struction) to the telephone RF unit 1 1 3, indicating to start 
transmitting/receiving telephone audio data, so as to 
make a call start. 

[0081] The same process is applicable to the case 
where the user makes a phone call while watching and 
listening a digital broadcast program. 
[0082] More particularly, when the user presses the 
call start/end button 116, the event analysis processing 
unit 1 1 2 detects a send event, and instructs the program 
information processing unit 104 to mute the digital 
broadcast audio and display the caption data. At the 
same time, the event analysis processing unit 1 1 2 trans- 
mits an instruction message (received telephone audio 
data switch instruction) to the audio path switching con- 
trol unit 109 to switch the audio path to the output side 
of the telephone audio processing unit 114. 
[0083] Then, the program information processing unit 
104, with reference to the program information, trans- 
mits to the multiplexed transmission separating unit 1 03 
an instruction message (audio data extraction stop in- 
struction) to stop separating the audio data of the digital 
broadcast, and an instruction message (text data ex- 
traction start instruction) to start separating the caption 
data with the presence of the caption data. The multi- 
plexed transmission separating unit 103 stops separat- 
ing the audio data of the digital broadcast and starts sep- 
arating the caption data. The digital broadcast audio 
processing unit 107 starts muting and the caption/data 
broadcast processing unit 1 05 starts decoding the cap- 
tion data. 

[0084] The display superimposing unit 108 superim- 
poses the caption data onto the video data, and displays 
it on the display output unit 110. 
[0085] In the meantime, the audio path switching con- 
trol unit 109 switches the audio path to the telephone 
side. 

[0086] Also, in the meantime, the event analysis 
processing unit 112 transmits an instruction message 
(telephone audio data transmission/reception start in- 
struction) to the telephone RF unit 1 1 3 to start transmit- 
ting/receiving telephone audio data so as to make a call 
start. 

[0087] An operation will be discussed of the case 
where the user ends a call. 

[0088] It is to be noted that this case includes the sit- 
uation that a digital broadcast wave is being received by 
the digital broadcast tuner unit 1 01 , and the separation 
of video data and caption data is in process in the mul- 
tiplexed transmission separating unit 103, whereas the 
separation of audio data is stopped, and the video data 
and the caption data are being outputted from the dis- 
play output unit 110. In the meantime, telephone audio 



data is being transmitted/received through the tele- 
phone RF unit 1 13, the telephone audio processing unit 
114, and the audio input unit 115, and telephone audio 
data is being outputted from the audio output unit 111 . 

5 Also, in the meantime, the audio path is set on the tele- 
phone side by the audio path switching control unit 109. 
[0089] When the user presses the call start/end but- 
ton 116, the event analysis processing unit 112 detects 
an end event, and transmits an instruction message (tel- 

10 ephone audio data transmission/reception stop instruc- 
tion) to the telephone RF unit 1 1 3 so as to make the call 
end. 

[0090] If a dialoguer (the other party) ends the call 
first, then the telephone RF unit 1 1 3 gives the end event 

15 to the event analysis processing unit 112. 

[0091 ] Also, the event analysis processing unit 1 1 2 at 
the same time instructs the program information 
processing unit 1 04 to start separating the audio data of 
the digital broadcast (digital broadcast audio return) and 

20 stop separating the caption data (caption deletion). Still 
also, the event analysis processing unit 112 transmits 
an instruction message (extracted audio data switch in- 
struction) to the audio path switching control unit 1 09 to 
switch the audio path to the output side of the digital 

25 broadcast audio processing unit 1 07. 

[0092] The program information processing unit 104 
transmits an instruction message (audio data extraction 
start instruction and text data extraction stop instruction) 
to the multiplexed transmission separating unit 103, in- 

30 structing to start separating the audio data of the digital 
broadcast and stop separating the caption data. 
[0093] The multiplexed transmission separating unit 
1 03 starts separating the audio data of the digital broad- 
cast and stop separating the caption data, and the digital 

35 broadcast audio processing unit 1 07 starts decoding the 
audio and the caption/data broadcast processing unit 
105 stops decoding the caption data. 
[0094] As a result, the display superimposing unit 1 08 
displays video data outputted from the digital broadcast 

40 video processing unit 106 alone on the display output 
unit 110. 

[0095] The audio path switching control unit 109, up- 
on receiving the instruction message from the event 
analysis processing unit 1 1 2, switches the audio path to 
45 the digital broadcast audio side and makes the audio 
data of the digital broadcast outputfrom the audio output 
unit 111. 

[0096] Fig. 2 shows a flow of an internal operation of 
the hybrid terminal upon receiving/transmitting a call. 

50 Fig. 3 shows an example of events/states that the event 
analysis processing unit handles. Fig. 3(a) includes the 
states to be managed by the event analysis processing 
unit. Fig. 3(b) includes events to be managed by the 
event analysis processing unit. 

55 [0097] The thus configured hybrid terminal of a mobile 
phone and a digital broadcast receiver allows providing 
the user with calling and receiving a digital broadcast 
upon receiving/transmitting a call while at the same time 
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receiving the digital broadcast. In addition, this hybrid 
terminal, being thus designed to displaying caption data 
only while the phone is used, allows reducing the period 
of displaying caption data on a small screen. 

Embodiment 2. 

[0098] Fig. 4 shows a hybrid terminal of a mobile 
phone equipped with a hands free function and a digital 
broadcast receiver according to a second embodiment 
of the present invention. With referring to the figure, a 
reference numeral 1 01 denotes a digital broadcasttuner 
unit, a reference numeral 102 denotes a digital broad- 
cast demodulating unit, a reference numeral 103 de- 
notes a multiplexed transmission separating unit, a ref- 
erence numeral 104 denotes a program information 
processing unit, a reference numeral 105 denotes a 
caption/data broadcast processing unit, a reference nu- 
meral 1 06 denotes a digital broadcast video processing 
unit, a reference numeral 107 denotes a digital broad- 
cast audio processing unit, a reference numeral 1 08 de- 
notes a display superimposing unit, a reference numeral 
109 denotes an audio path switching control unit, a ref- 
erence numeral 1 1 0 denotes a display output unit, a ref- 
erence numeral 111 denotes an audio output unit, a ref- 
erence numeral 1 1 2 denotes an event analysis process- 
ing unit, a reference numeral 113 denotes a telephone 
RF unit, a reference numeral 114 denotes a telephone 
audio processing unit, a reference numeral 115 denotes 
an audio input unit, a reference numeral 116 denotes a 
call start/end button, a reference numeral 117 denotes 
a CPU, a reference numeral 118 denotes a memory, a 
reference numeral 201 denotes a hands free control 
unit, a reference numeral 202 denotes an amplified au- 
dio output unit, and a reference numeral 203 denotes a 
ear audio output unit. 

[0099] The amplified audio output unit 202 is to output 
the telephone audio data of the mobile phone in the 
hands free mode and the audio data of a digital broad- 
cast. The ear audio output unit 203 is to output the tel- 
ephone audio data of the mobile phone in the normal 
mode. 

[0100] The hands free control unit 201 provides on/off 
control of the hands free function. The hands free func- 
tion is well known art of mobile phone, and therefore will 
not be elaborated here. It is to be noted that the hands 
free control unit 201 is an example of an amplified audio 
ear audio selecting unit. 

[0101] Similarly to the first embodiment, the audio 
path is switched to the telephone side by the event anal- 
ysis processing unit 112 upon receiving/transmitting a 
mobilephone call while atthesametime receiving a dig- 
ital broadcast. In this case, however, the event analysis 
processing unit 112 makes a request to the hands free 
control unit 201 for turning on the hands free mode 
(transmitting an amplified audio selection instruction), 
and the hands free control unit 201 turns on the hands 
free mode (selecting an amplified audio output unit.) It 



is to be noted that the other parts of processing is the 
same as those discussed in the first embodiment. 
[01 02] The thus configured hybrid terminal of a mobile 
phone and a digital broadcast receiver, being designed 
5 to automatically select the hands free mode upon re- 
ceiving a call while at the same time receiving a digital 
broadcast, allows a pleasant call on the mobile phone 
while at the same time receiving a digital broadcast. 



[0103] Fig. 5 shows a hybrid terminal of a mobile 
phone capable of presetting reception of programs and 
a digital broadcast receiver according to a third embod- 

15 iment of the present invention. With referring to the fig- 
ure, a reference numeral 101 denotes a digital broad- 
cast tuner unit, a reference numeral 1 02 denotes a dig- 
ital broadcast demodulating unit, a reference numeral 
1 03 denotes a multiplexed transmission separating unit, 

20 a reference numeral 1 04 denotes a program information 
processing unit, a reference numeral 105 denotes a 
caption/data broadcast processing unit, a reference nu- 
meral 106 denotes a digital broadcast video processing 
unit, a reference numeral 107 denotes a digital broad- 

25 cast audio processing unit, a reference numeral 1 08 de- 
notes a display superimposing unit, a reference numeral 
109 denotes an audio path switching control unit, a ref- 
erence numeral 1 1 0 denotes a display output unit, a ref- 
erence numeral 1 1 1 denotes an audio output unit, a ref- 

30 erence numeral 1 1 2 denotes an event analysis process- 
ing unit, a reference numeral 113 denotes a telephone 
RF unit, a reference numeral 114 denotes a telephone 
audio processing unit, a reference numeral 1 1 5 denotes 
an audio input unit, a reference numeral 116 denotes a 

35 call start/end button, a reference numeral 117 denotes 
a CPU, a reference numeral 1 1 8 denotes a memory, and 
a reference numeral 301 denotes a reception preset 
processing unit. 

[0104] The reception preset processing unit 301 ana- 

40 lyzes the schedule of a program based on program in- 
formation that is transmitted via a digital broadcast 
wave, and presets the program for reception. This is well 
known art in digital broadcast processing, and therefore 
will not be elaborated here. It is to be noted that the re- 

45 ception preset processing unit 301 is a multiplexed data 
reception start time managing unit. 
[0105] According to the third embodiment of the 
present invention, when a preset program for reception 
starts via a preset function of the reception preset 

50 processing unit 301 , the reception preset processing 
unit 301 instructs the digital broadcast tuner unit 101 to 
start a reception (transmitting a multiplexed data recep- 
tion start instruction), and at the same time gives a re- 
ception start event to the event analysis processing unit 

55 112 (transmitting a multiplexed data reception start no- 
tification). The event analysis processing unit 112 judg- 
es whether or not the user is on the telephone, and in 
other words judges whether or not telephone audio data 
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is being transmitted/received. 

[0106] When the user is on the telephone (telephone 
audio data is being transmitted/received), the event 
analysis processing unit 1 1 2 instructs the program infor- 
mation processing unit 1 04 to mute the digital broadcast 
audio and display the caption data. Also, the event anal- 
ysis processing unit 112, without instructing the audio 
path switching control unit 1 09 to switch the audio path, 
keeps the audio path on the telephone side. It is to be 
noted that the other parts of processing is the same as 
those discussed in the first embodiment. 
[0107] Fig. 6 shows a control flow upon starting to re- 
ceive a digital broadcast. 

[0108] It is desirable that the hands free mode is se- 
lected for calling as discussed in the second embodi- 
ment. 

[0109] The thus configured hybrid terminal of a mobile 
phone and a digital broadcast receiver allows using the 
mobile phone while at the same time receiving a digital 
broadcast, even if a digital broadcast program preset for 
reception started while using the phone. 

Embodiment 4. 

[0110] Fig. 7 shows a hybrid terminal of a mobile 
phone capable of presetting reception of programs and 
a digital broadcast receiver according to a fourth em- 
bodiment of the present invention. With referring to the 
figure, a reference numeral 1 01 denotes a digital broad- 
cast tuner unit, a reference numeral 1 02 denotes a dig- 
ital broadcast demodulating unit, a reference numeral 
1 03 denotes a multiplexed transmission separating unit, 
a reference numeral 1 04 denotes a program information 
processing unit, a reference numeral 105 denotes a 
caption/data broadcast processing unit, a reference nu- 
meral 1 06 denotes a digital broadcast video processing 
unit, a reference numeral 107 denotes a digital broad- 
cast audio processing unit, a reference numeral 1 08 de- 
notes a display superimposing unit, a reference numeral 
109 denotes an audio path switching control unit, a ref- 
erence numeral 1 1 0 denotes a display output unit, a ref- 
erence numeral 111 denotes an audio output unit, a ref- 
erence numeral 1 1 2 denotes an event analysis process- 
ing unit, a reference numeral 113 denotes a telephone 
RF unit, a reference numeral 114 denotes a telephone 
audio processing unit, a reference numeral 115 denotes 
an audio input unit, a reference numeral 116 denotes a 
call start/end button, a reference numeral 117 denotes 
a CPU, a reference numeral 118 denotes a memory, a 
reference numeral 301 denotes a reception preset 
processing unit, a reference numeral 401 denotes a vi- 
brator control unit, and a reference numeral 402 denotes 
a vibrator. 

[0111] The vibrator control unit 401 and the vibrator 
402 are used for informing of the reception of a mobile 
phone call as well. This is well known art, and therefore 
will not be elaborated here. 

[0112] According to the fourth embodiment of the 



present invention, when a program preset for reception 
starts via the preset function of the reception preset 
processing unit 301 , the event analysis processing unit 
112 receives a reception start event, and judges wheth- 

5 er or not the user is on the telephone. 

[0113] When the user is on the telephone, an instruc- 
tion message (vibrator start instruction) is transmitted to 
the vibrator control unit 401 , instructing to turn on the 
vibrator, and the vibrator control unit 401 makes the vi- 

10 brator 402 start. 

[01 1 4] The same operations as those of the first em- 
bodiment of the present invention follow subsequently. 
[0115] The thus configured hybrid terminal of a mobile 
phone and a digital broadcast receiver allows the user 

15 on the phone to know the start of a program preset for 
reception easily by applying the vibrator, which is de- 
signed originally for notifying of the reception of a mobile 
phone call, to the start notification of a program preset 
for reception as well. 

20 [0116] It is desirable that the hands free mode is se- 
lected for calling as discussed in the second embodi- 
ment. 

[0117] With reference to the first to fourth embodi- 
ments, descriptions were given of the hybrid terminal of 

25 a mobile phone and a digital broadcast receiver as an 
example. Alternatively, however, the mechanisms dis- 
cussed in the first to fourth embodiments are also appli- 
cable to a hybrid terminal of a wired fixed telephone and 
a digital broadcast receiver. 

30 [0118] Further with reference to the first to fourth em- 
bodiments, descriptions were given of the hybrid termi- 
nal receiving digital broadcasts as an example. Alterna- 
tively, however, the mechanism discussed in the first to 
fourth embodiments is also applicable to a hybrid termi- 

35 nal receiving analog broadcasts. 

[0119] Still further with reference to the first to fourth 
embodiments, descriptions were given of the communi- 
cation apparatus according to this invention as an ex- 
ample. Alternatively, however, a communication method 

40 may also be implemented according to this invention 
based on the processing procedures discussed in the 
first to fourth embodiments. 

[0120] Now, the characteristics of the hybrid terminal 
discussed in the first to fourth embodiment will be reit- 

45 erated below. 

[0121] The hybrid terminal discussed in the first to 
fourth embodiments is characterized by including the 
tuner unit for receiving a digital broadcast, the digital 
broadcast demodulating unit for demodulating the dig- 

50 ital broadcast, the multiplexed transmission separating 
unit for separating multiplexed transmission data, the 
program information processing unit for analyzing the 
program information, instructing the digital broadcast 
tuner unit to select a station and instructing the multi- 

55 plexed transmission separating unit to carry outthe sep- 
aration, the caption/data broadcast processing unit for 
decoding a caption data broadcast separated by the 
multiplexed transmission separating unit, the digital 
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broadcast video processing unit for decoding a video 
broadcast also separated by the multiplexed transmis- 
sion separating unit, the digital broadcast audio 
processing unit for decoding digital broadcast audio 
separated alike by the multiplexed transmission sepa- 5 
rating unit, the display superimposing unit for superim- 
posing the caption/data broadcast onto the video broad- 
cast, the telephone RF unit for carrying out telephone 
wireless processing, the telephone audio processing 
unit for processing telephone audio, the event analysis 10 
processing unit for analyzing/processing the receive/ 
send event of a call, the audio path switching control unit 
for switching between the digital broadcast audio output 
and the telephone audio output, and the audio output 
unit. is 
[0122] Then, the hybrid terminal is characterized by 
switching the audio path to the telephone side, display- 
ing a caption, and allowing calling, in the case of receiv- 
ing a call while atthesametime receiving a digital broad- 
cast, and in the case where the call is finished, switching 20 
the audio path to the digital broadcast audio side, delet- 
ing the caption, and displaying the digital broadcast vid- 
eo alone. 

[0123] The hybrid terminal discussed in the first em- 
bodiment is characterized in that, upon receiving a call 25 
while at the same time receiving a digital broadcast, the 
event analysis processing unit makes a request to the 
program information processing unit for displaying the 
caption separated and stopping separating the digital 
broadcast audio/muting, and the event analysis 30 
processing unit also makes a request to the audio path 
switching control unit for switching the audio path, so 
that the caption display and the audio path are switched. 
[0124] The hybrid terminal discussed in the first em- 
bodiment is characterized in that, upon transmitting a 35 
call while at the same time receiving a digital broadcast, 
the event analysis processing unit makes a request to 
the program broadcast processing unitfordisplayingthe 
caption, and the event analysis processing unit also 
makes a request to the audio path switching control unit 40 
for switching the audio path, so that the caption display 
and the audio path are switched. 
[0125] The hybrid terminal discussed in the second 
embodiment is characterized by adding the hands free 
control unit, muting and displaying the caption upon re- 45 
ceiving a call while at the same time receiving a digital 
broadcast, and switching at the same time to the hands 
free mode. 

[0126] The hybrid terminal discussed in the third em- 
bodiment is characterized by adding the reception pre- 50 
set processing unit, and also characterized in that the 
program information processing unit outputs the caption 
instead of the audio when a program presetfor reception 
starts while the phone is used at the same time. 
[0127] The hybrid terminal discussed in the fourth em- 55 
bodiment is characterized by adding the vibrator control 
unit and the vibrator, and also characterized in that, 
when a program presetfor reception starts while the us- 
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er is on the telephone at the same time, the start of the 
program is notified to the user via the vibrator, and the 
program information processing unit outputs the caption 
instead of the audio. 

Industrial Applicability 

[0128] Thus, according to the present invention, in the 
case where the receive event or the send event is gen- 
erated while the multiplexed data is received, the audio 
output is switched so that the received telephone audio 
data is outputted, and in the case where the end event 
is generated while the multiplexed data is received, the 
audio output is switched so that the extracted audio data 
is outputted. Hence, both receiving/outputting the mul- 
tiplexed data and calling may be implemented. 
[0129] Furthermore, according to the present inven- 
tion, in the case where the receive event or the send 
event is generated while the multiplexed data is re- 
ceived, the extracted text data is started to be displayed, 
and in the case where the end event is generated while 
the multiplexed data is received, the extracted text data 
is stopped being displayed. Hence, the period of dis- 
playing text data may be minimized. 
[0130] Still further according to the present invention, 
in the case where the receive event or the send event 
is generated while the multiplexed data is received, the 
amplified audio is outputted. Hence, both receiving/out- 
putting the multiplexed data and calling may be imple- 
mented with hands free. 

[0131] Still further according to the present invention, 
when telephone audio is being transmitted/received at 
the multiplexed data reception start time, switching to 
the extracted audio data is not performed. Hence, both 
receiving/outputting the multiplexed data and calling 
may be implemented even in the event that the recep- 
tion is started of the multiplexed data while the phone is 
used at the same time. 

[0132] Still further according to the present invention, 
when telephone audio data is being transmitted/re- 
ceived at the multiplexed data reception start time, the 
vibrator is started. Hence, the start of receiving the mul- 
tiplexed data may be notified via the vibrator even in the 
event thatthe reception is started of the multiplexed data 
while the phone is used at the same time. 



Claims 

1. A communication apparatus comprising: 

a multiplexed data receiving unit for receiving 
multiplexed data at least including audio data; 
an extracting unit for extracting the audio data 
from the multiplexed data; 
a telephone unit for transmitting/receiving tele- 
phone audio data; 

an audio output unit for inputting one of extract- 
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ed audio data that was extracted by the extract- 
ing unit and received telephone audio data that 
was received by the telephone unit, and output- 
ting one of the extracted audio data inputted 
and the received telephone audio data input- 5 
ted; 

a switching control unit for switching an input to 
the audio output unit between the extracted au- 
dio data and the received telephone audio data; 
and 10 
an instructing unit for detecting a receive event 
generation, a send event generation, and an 
end event generation, and giving a prescribed 
instruction to the telephone unit, the extracting 
unit, and the switching control unit, 15 

wherein the instructing unit, in a case of de- 
tecting one of the receive event generation and the 
send event generation while the multiplexed data is 
received by the multiplexed data receiving unit, 20 
transmits a telephone audio data transmission/re- 
ception start instruction to the telephone unit to start 
transmitting/receiving the telephone audio data, 
transmits an audio data extraction stop instruction 
to the extracting unit to stop extracting the audio da- 25 
ta, and transmits a received telephone audio data 
switch instruction to the switching control unit to 
switch to the received telephone audio data, and in 
a case of detecting the end event generation while 
the multiplexed data is received by the multiplexed 30 
data receiving unit, transmits a telephone audio da- 
ta transmission/reception stop instruction to the tel- 
ephone unit to stop transmitting/receiving the tele- 
phone audio data, transmits an audio data extrac- 
tion start instruction to the extracting unit to start ex- 35 
tracting the audio data, and transmits an extracted 
audio data switch instruction to the switching control 
unit to switch to the extracted audio data, 

wherein the telephone unit, in a case of re- 
ceiving the telephone audio data transmission/re- 40 
ception start instruction from the instructing unit, 
starts transmitting/receiving the telephone audio 
data, and in a case of receiving the telephone audio 
data transmission/reception stop instruction from 
the instructing unit, stops transmitting/receiving the 45 
telephone audio data, 

wherein the extracting unit, in a case of receiv- 
ing the audio data extraction stop instruction from 
the instructing unit, stops extracting the audio data, 
and in a case of receiving the audio data extraction 50 
start instruction, starts extracting the audio data, 
and 

wherein the switching control unit, in a case 
of receiving the received telephone audio data 
switch instruction from the instructing unit, switches 55 
the input to the audio output unit to the received tel- 
ephone audio data, and in a case of receiving the 
extracted audio data switch instruction from the in- 



structing unit, switches the input to the audio output 
unit to the extracted audio data. 

2. The communication apparatus according to claim 
1 , wherein the multiplexed data receiving unit re- 
ceives multiplexed data including video data and 
text data, and 

wherein the extracting unit extracts the video 
data from the multiplexed data, and also extracts 
the text data in a prescribed case, 

the communication apparatus, further com- 
prising: 

a display output unit for outputting extracted 
video data that was extracted by the extracting 
unit, and for outputting extracted text data in a 
case where the text data was extracted by the 
extracting unit, 

wherein the instructing unit transmits a text 
data extraction start instruction to the extracting unit 
to start extracting the text data in a case of detecting 
one of the receive event generation and the send 
event generation while the multiplexed data is re- 
ceived by the multiplexed data receiving unit, and 
transmits a text data extraction stop instruction to 
the extracting unit to stop extracting the text data in 
a case of detecting the end event generation while 
the multiplexed data is received by the multiplexed 
data receiving unit, and 

wherein the extracting unit starts extracting 
the text data in a case of receiving the text data ex- 
traction start instruction from the instructing unit, 
and stops extracting the text data in a case of re- 
ceiving the text data extraction stop instruction from 
the instructing unit. 

3. The communication apparatus according to claim 
1 , wherein the audio output unit is an amplified au- 
dio output unit for amplifying volume of and then 
outputting one of the extracted audio data inputted 
and the received telephone audio data inputted and 
outputting, 

the communication apparatus, further com- 
prising: 

a ear audio output unit for outputting the re- 
ceived telephone audio data in a prescribed 
case; and 

an amplified audio ear audio selecting unit for 
selecting one of the amplified audio output unit 
and the ear audio output unit, and making the 
one of the amplified audio output unit and the 
ear audio output unit output the received tele- 
phone audio data based on a selected result; 

wherein the instructing unit transmits an am- 
plified audio select instruction to the amplified audio 
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plexed data reception start notification to the in- 
structing unit of a start of receiving the multi- 
plexed data by the multiplexed data receiving 
unit; 



ear audio selecting unitto select the amplified audio 
output unit, in a case of detecting one of the receive 
event generation and the send event generation 
while the multiplexed data is received by the multi- 
plexed data receiving unit, and 5 

wherein the amplified audio ear audio select- 
ing unit selects the amplified audio output unit in a 
case of receiving the amplified audio select instruc- 
tion from the instructing unit, and makes the ampli- 
fied audio output unit output the received telephone 10 
audio data. 



4. The communication apparatus according to claim 

1 , further comprising: 

15 

a multiplexed data reception start time manag- 
ing unit, for managing time for the multiplexed 
data receiving unit to start receiving the multi- 
plexed data as multiplexed data reception start 
time, transmitting with an arrival of the multi- 20 
plexed data reception start time a multiplexed 
data reception start instruction to the multi- 
plexed data receiving unit to start receiving the 
multiplexed data, and transmitting a multi- 
plexed data reception start notification to the in- 25 
structing unit of a start of receiving the multi- 
plexed data by the multiplexed data receiving 
unit; 

wherein the multiplexed data receiving unit 30 
starts receiving the multiplexed data in a case of re- 
ceiving the multiplexed data reception start instruc- 
tion from the multiplexed data reception start time 
managing unit, and 

wherein the instructing unit judges whether 35 
the telephone audio data is being transmitted/re- 
ceived by the telephone unit upon receiving the mul- 
tiplexed data reception start notification from the 
multiplexed data reception start time managing unit, 
and transmits the audio data extraction stop instruc- 40 
tion to the extracting unit in a case where the tele- 
phone audio data is being transmitted/received by 
the telephone unit, so that the instructing unit does 
not transmits the extracted audio data switch in- 
struction to the switching control unit. 45 

5. The communication apparatus according to claim 

2, further comprising: 

a multiplexed data reception start time manag- 50 
ing unit, for managing time for the multiplexed 
data receiving unit to start receiving the multi- 
plexed data as multiplexed data reception start 
time, transmitting with an arrival of the multi- 
plexed data reception start time a multiplexed 55 
data reception start instruction to the multi- 
plexed data receiving unit to start receiving the 
multiplexed data, and transmitting a multi- 



wherein the multiplexed data receiving unit 
starts receiving the multiplexed data in a case of re- 
ceiving the multiplexed data reception start instruc- 
tion from the multiplexed data reception start time 
managing unit, and 

wherein the instructing unit judges whether 
the telephone audio data is being transmitted/re- 
ceived bythetelephone unit upon receiving the mul- 
tiplexed data reception start notification from the 
multiplexed data reception start time managing unit, 
and transmits the text data extraction start instruc- 
tion to the extracting unit in a case where the tele- 
phone audio data is being transmitted/received by 
the telephone unit. 

6. The communication apparatus according to claim 4 
or 5, further comprising: 

a vibrator; and 

a vibrator control unit for controlling the vibra- 
tor; 

wherein the instructing unit judges whether 
the telephone audio data is being transmitted/re- 
ceived by the telephone unit in a case of receiving 
the multiplexed data reception start notification from 
the multiplexed data reception start time managing 
unit, and transmits a vibrator start instruction to the 
vibrator control unit to start the vibrator in a case 
where the telephone audio data is being transmit- 
ted/received by the telephone unit, and 

wherein the vibrator control unit starts the vi- 
brator in a case of receiving the vibrator start in- 
struction from the instructing unit. 

7. The communication apparatus according to claim 
1 , 2, 3, 4 or 5, wherein the communication appara- 
tus is a mobile type communication apparatus. 

8. A communication method, comprising: 

a multiplexed data receiving step for receiving 

multiplexed data at least including audio data; 

an extracting step for extracting the audio data 

from the multiplexed data; 

a telephone audio data transmitting/receiving 

step for transmitting/receiving telephone audio 

data; 

an audio output step for inputting one of extract- 
ed audio data that was extracted by the extract- 
ing step and received telephone audio data that 
was received by the telephone audio data 
transmitting/receiving step, and outputting one 
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24 



23 

of the extracted audio data inputted and the re- 
ceived telephone audio data inputted; 
a switching control step for switching an input 
to the audio output step between the extracted 
audio data and the received telephone audio 5 
data; and 

an instructing step for detecting a receive event 
generation, a send event generation, and an 
end event generation, and giving a prescribed 
instruction to the telephone audio data trans- 10 
mitting/receiving step, the extracting step, and 
the switching control step, 

wherein the instructing step, in a case of de- 
tecting one of the receive event generation and the 15 
send event generation while the multiplexed data is 
received by the multiplexed data receiving step, 
gives a telephone audio data transmission/recep- 
tion start instruction to the telephone audio trans- 
mitting/receiving step to start transmitting/receiving 20 
the telephone audio data, gives an audio data ex- 
traction stop instruction to the extracting step to stop 
extracting the audio data, and gives a received tel- 
ephone audio data switch instruction to the switch- 
ing control step to switch to the received telephone 25 
audio data, and in a case of detecting the end event 
generation while the multiplexed data is received by 
the multiplexed data receiving step, gives a tele- 
phone audio data transmission/reception stop in- 
struction to the telephone audio transmitting/receiv- 30 
ing step to stop transmitting/receiving the telephone 
audio data, gives an audio data extraction start in- 
struction to the extracting step to start extracting the 
audio data, and gives an extracted audio data 
switch instruction to the switching control step to 35 
switch to the extracted audio data, 

wherein the telephone audio transmitting/re- 
ceiving step, in a case of receiving the telephone 
audio data transmission/reception start instruction 
from the instructing step, starts transmitting/receiv- 40 
ing the telephone audio data, and in a case of re- 
ceiving the telephone audio data transmission/re- 
ception stop instruction from the instructing step, 
stops transmitting/receiving the telephone audio 
data, 45 

wherein the extracting step, in a case of re- 
ceiving the audio data extraction stop instruction 
from the instructing step, stops extracting the audio 
data, and in a case of receiving the audio data ex- 
traction start instruction, starts extracting the audio 50 
data, and 

wherein the switching control step, in a case 
of receiving the received telephone audio data 
switch instruction from the instructing step, switch- 
es the input to the audio output step to the received 55 
telephone audio data, and in a case of receiving the 
extracted audio data switch instruction from the in- 
structing step, switches the inputto the audio output 



step to the extracted audio data. 

9. The communication method according to claim 8, 
wherein the multiplexed data receiving step re- 
ceives multiplexed data including video data and 
text data, and 

wherein the extracting step extracts the video 
data from the multiplexed data, and also extracts 
the text data in a prescribed case, 

the communication method, further compris- 
ing: 

a display output step for outputting extracted 
video data that was extracted by the extracting 
step, and in a case where the text data was ex- 
tracted by the extracting step, outputting ex- 
tracted text data that was extracted, 

wherein the instructing step gives a text data 
extraction start instruction to the extracting step to 
start extracting the text data in a case of detecting 
one of the receive event generation and the send 
event generation while the multiplexed data is re- 
ceived by the multiplexed data receiving step, and 
gives a text data extraction stop instruction to the 
extracting step to stop extracting the text data in a 
case of detecting the end event generation whilethe 
multiplexed data is received by the multiplexed data 
receiving step, and 

wherein the extracting step starts extracting 
the text data in a case of receiving the text data ex- 
traction start instruction from the instructing step, 
and stops extracting the text data in a case of re- 
ceiving the text data extraction stop instruction from 
the instructing step. 
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Fig. 1 
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Fig. 2 
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Fig. 3 
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Fig. 4 
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Fig. 5 
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Fig. 7 
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Fig. 8 
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